Multi-Perspective Context Matching for SQuAD Dataset

نویسندگان

  • Huizi Mao
  • Xingyu Liu
چکیده

Question answering is an important task in machine comprehension. The new SQuAD dataset allows us to deploy recent NLP deep learning techniques and train an end-to-end system to predict the start and end position of the answer in the given context, instead of precisely selecting the words of the correct answer. We propose to use combine bi-directional LSTM (BiLSTM) and context matching to develop a model for SQuAD dataset. We first use two BiLSTMs to encode the context and question word sequence. Then we apply context matching from multiple perspectives to produce a matching vector. Finally another BiLSTM is applied to the matching vector to predict the start and end positions. Several other tricks are also explored to enhance the prediction accuracy. Experimental results show that our model can achieve an F1 score of 61.27 and EM score of 49.50 on the development set.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Question Answering with SQuAD: Variations on Multi-Perspective Context Matching

We implement multi-perspective context matching for the task of questionanswering on the SQuAD dataset and explore a variety of modifications to this core architecture. In our first modification, we compare the performance of GRUs with that of LSTMs in the original model. Next we attempt to predict the answer’s start index and length rather than its start and end indices. Finally, we introduce ...

متن کامل

∗NQSotA Continuation Curriculum Learning with Question Answering on the SQuAD Dataset

We implement a slightly simplified Bi-Directional Attention Flow Model[4] and a slightly modified Multi-Perspective Context Matching[6] model for Question Answering on the SQuAD dataset. In the Multi-Perspective model, we add perspective matching between forward and backward contexts. We omit the character-level embeddings of both models, and make a few other small simplifications. We briefly l...

متن کامل

Reading Comprehension with SQuAD

The SQuAD dataset provides a reading comprehension task, with (question, answer, context) pairs. This paper attempts to develop a model to predict the answer for a given question, context pair. In a model inspired by ”Multi-Perspective Context Matching for Machine Comprehension” by Wang et al, this paper achieves 0.47 F1 score on a validation set.

متن کامل

Assignment 4: Question Answering on the SQuAD Dataset with Part-of-speech Tagging

This research applies deep learning with bi-LSTMs to train a model that responds to queries on the Stanford Question Answering Dataset (SQuAD). The model design was motivated by Wang et. al.’s December 2016 IBM Research paper on multi-perspective context matching for machine comprehension. Using TensorFlow, we implemented a multi-layer neural network architecture utilizing bi-directional LSTMs ...

متن کامل

Multi-Perspective Context Matching for Machine Comprehension

Previous machine comprehension (MC) datasets are either too small to train endto-end deep learning models, or not difficult enough to evaluate the ability of current MC techniques. The newly released SQuAD dataset alleviates these limitations, and gives us a chance to develop more realistic MC models. Based on this dataset, we propose a Multi-Perspective Context Matching (MPCM) model, which is ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2017